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Abstract. The purpose of this paper is to study the asymptotic behavior of 
the weighted least square estimators of the unknown parameters of random co- 
efficient bifurcating autoregressive processes. Under suitable assumptions on the 
immigration and the inheritance, we establish the almost sure convergence of our 
estimators, as well as a quadratic strong law and central limit theorems. Our 
study mostly relies on limit theorems for vector- valued martingales. 



In this paper, we will study random coefficient autoregressive bifurcating autore- 
gressive processes (RCBAR). Those processes are an adaptation of random coef- 
ficient autoregressive processes (RCAR) to binary tree structured data. We can 
also see those processes as the combination of RCAR processes and bifurcating au- 
toregressive processes (BAR). RCAR processes have been first studied by Nicholls 
and Quinn [T71 118] while BAR processes have been first investigated by Cowan and 
Staudte [5J. Both inherited and environmental effects are taken into consideration 
in RCBAR processes in order to explain the evolution of the characteristic under 
study. The binary tree structure could lead us to take cell division as an example. 

More precisely, the first-order RCBAR process is defined as follows. The initial 
cell is labelled 1 and the offspring of the cell labelled n are labelled In and 2n + 1. 
Denote by X n the characteristic of individual n. Then, the first-order RCBAR 
process is given, for all n > 1, by 



The environmental effect is given by the driven noise sequence {e-im ^2n+i)n>i while 
the inherited effect is given by the random coefficient sequence (a n , & n ) ra >i- The cell 
division example leads us to consider that E2 n and E2 n +i are correlated since the 
environmental effect on two sister cells can reasonably be seen as correlated. 
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This paper, which is an adaptation of jl] to RCBAR processes, intends to study 
the asymptotic behavior of the weighted least squares (WLS) estimators of first-order 
RCBAR processes using a martingale approach. This martingale approach has been 
first proposed by Bercu et al. [3] and de Saporta et al. |6] for BAR processes. The 
WLS estimation of parameters branching processes was previously investigated by 
Wei and Winnicki |22j and Winnicki [23j. We will make use several times of the 
strong law of large numbers [8] as well as the central limit theorem [8j [10] for mar- 
tingales, in order to investigate the asymptotic behavior of the WLS estimators. 
Those theorems have been previously used by Basawa and Zhou [2j |2U l2"5] . 

Several approaches appeared for BAR processes, and we tried not to set aside any 
of them. Thus, we took into account the classical BAR studies as seen in Huggins 
and Basawa [121 IT3] and Huggins ans Staudte p3] who studied the evolution of cell 
diameters and lifetimes, and also the bifurcating Markov chain model introduced by 
Guyon |9] and used in Delmas and Marsalle |7J. Still, we did not forget to have a look 
to the analogy with the Galton- Watson processes as studied in Delmas and Marsalle 
[7] and Heyde and Seneta [llj. Several methods have also been used for parameter 
estimation in RCAR processes. Koul and Schick [TB] used an M-estimator while Aue 
et al. [lj prefered a quasi-maximum likelihood approach. Schick jTH] introduced a 
new class of estimator that Vanecek [20J used in his work. Hwang et al. |15j also 
tackled the critical case where the environmental effect follows a Rademacher dis- 
tribution. 



The paper is organised as follows. Section 2 allows us to explain more precisely the 
model in which we are interested in, then Section 3 formulates the WLS estimators 
of the unknown parameters we will study. Section 4 permits us to introduce the 
martingale point of view of this paper. Section 5 collects oiur results concerning the 
asymptotic behavior of our WLS estimators, to be more accurate, we will establish 
the almost sure convergence, the quadratic strong law ond the asymptotic normality 
of our estimators. Finally, the other sections gathers the proofs of our main results. 

2. Bifurcating integer-valued autoregressive processes 
Consider the first-order RCBAR process given, for all n > 1, by 

X2n = 0"n,X n + E2n 
X2n+l — b n X n + £2n+l 



(2.1) 



where the initial state X\ is the ancestor of the process and (e2 n , ^2n+i) stands for 
the driven noise of the process. In all the sequel, we shall assume that E[Xf] < oo. 
We also assume that both (a n ,6„) n >i and (£ 2n , ^2n+i)n>i are i.i.d., and that those 



two sequences are independent. One can see the RCBAR process given by (2.1) as 
a first-order random coefficient autoregressive process on a binary tree, where each 
node represents an individual, node 1 being the original ancestor. For all n > 1, 
denote the n-th generation by 

G n = {2 n ,2 n+1 ,...,2 n+1 - 1}. 
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In particular, Go = {1} is the initial generation and Gi = {2, 3} is the first genera- 
tion of offspring from the first ancestor. Recall that the two offspring of individual 
n are labelled 2n and 2n + 1, or conversely, the mother of individual n is [n/2] where 
[x] stands for the largest integer less than or equal to x. Finally denote by 



T„ 



|J G n 



k=0 



the sub-tree of all individuals from the original individual up to the n-th gener- 
ation. On can observe that the cardinality |G n | of G n is 2 n while that of T n is 
|T|=2 n+1 -l. 




Figure 1. The tree associated with the RCBAR 



3. Weighted least-squares estimation 

Denote by F = (J r n ) n >o the natural filtration associated with the first-order 
RCBAR process, which means that T n is the a-algebra generated by all individ- 
uals up to the n-th generation, in other words J-" n = a{Xk, k G T n }. We will assume 
in all the sequel that, for all n > and for all k 6 G n , 

'EfafclJ-'n] = a a.s. 
E[6jt|J-" n ] = b a.s. 
E^fcl^n] = c a.s. 
E^k+ilFn] = d a.s. 



(3.1; 



Consequently, we deduce from ( |2.1[ ) and (3.1 ) that, for all n > and for all k G G n , 

^2fe+i = bXk + d + V2k+i, 
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where, V 2k = X 2k -E[X 2fc | Jn] and V 2k+1 = X 2k+1 -M[X 2k +i\ Fn)- Therefore, the two 
relations given by (3.2) can be rewritten in a classic autoregressive form 



(3.3) 
where 

X 2n 
. X 2n+ \ 

and the matrix parameter 



Xn = 0^ n + W n 



Xr, 



9 



X T 
1 



a b 
c d 



v 2n 

V2n+l 



Our goal is to estimate 9 from the observation of all individuals up to T n . We 
propose to make use of the WLS estimator 9 n of 9 which minimizes 



2 *■ — ' cu 

where the choice of the weighting sequence (c n ) n >i is crucial. We shall choose 
c n = 1 + X\ and we will go back to this suitable choice in Section [IJ Consequently, 
we obviously have for all n > 1 



(3.4) 
where 



fceT, 



Cfc 



In order to avoid useless invertibility assumption, we shall assume, without loss of 
generality, that for all n > 0, S n is invertible. Otherwise, we only have to add the 
identity matrix of order 2, I 2 to S n . In all what follows, we shall make a slight abuse 
of notation by identifying 9 as well as 9 n to 



vec(fl) 



and 



vec 



fa n \ 

c r 

I 



Therefore, we deduce from (3.4) that 



9 n = K\ E - vec ( $ ^) 



fceT„-i 



fcST„-l 



/ x k x 2k \ 
x 2k 

X k X 2k+ i 
\ X 2k+ i J 



where S T 
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)S n and <S> stands for the standard Kronecker product. Consequently, 



(3.3) yields to 



(3.5) 



e n -e = T,-\ J2 -vec($ fc ^ 

v 2k 

X k V 2k +l 

\ V 2k +i J 

In all the sequel, we shall make use of the following moment hypotheses. 
(H.l) For all k > 1, 

E[ajj] < 1 and E[b 2 k ] < I. 
(H.2) For all n > and for all k G G„ 

Var[afc|J>i] = cr 2 > and Varffofcl^n] = o" 2 > a.s. 

Var [e 2 fc | ^n] = o"c > and Varf^fc+il^n] = ^ > a.s. 
(H.3) For all n > and for all G G n+ i, if [k/2] ^ [1/2], e k and E\ are condition- 
ally independent given T n and for all k, I G G n , if k ^ I, (a k , and (a/, 6;) 
are conditionally independent given J-" n . While otherwise, it exists p 2 d < o 2 a 2 d 
and p 2 b < o 2 a a\ such that, for all k G G n 

E[(£2fe - c)(e 2 fc+i - tOl^n] = Pcd a - s - 
E[(o fc - a)(6 fc - 6)|7"„] = p a & a.s. 

(H.4) One can find \i\ > a\, \x\ > af, p\ > a\ and \i\ > a\ such that, for all n > 
and for all k G G„ 



E [(a, - 
E [(e 2k - c 



■Fn] = 



/'a 



/4 



and E [{b k — b) | J-" n ] = \l\ a.s. 
and E [(e 2k +i - df |J* n ] 



A*5 



a.s. 



In addition, it exists v 2 ah > p 2 c and i/ 2 d > p 2 cd such that, for all k G 



E[(a fc -a) 2 (6 fe -6) 2 |j; 



a 6 



and E[(e 2k - c) 2 (e 2k+ i - d) 2 \T n 



id 



a.s. 



(H.5) It exists t®, t®, r c 6 and r d such that 



E[(a* 



\F n ] = r a 6 and E [(b k - bf \JF n ] = r c 6 a.s. 



E [{e 2k - cf |J*J = r c 6 and E [(e 2 fc+i - d) 6 |-F n ] = rj a.s. 



One can observe that those hypotheses allows us to consider the deterministic case 
where it exists some constants a, b with max(|a|, |6|) < 1 such that, for all k > 1, 
a k = a and b k = b a.s. Moreover, under assumption (H|2]), we have for all n > 
and for all G G n 

(3.6) E[V 2 k \F n ] = a 2 a X 2 + a 2 c and E[V 2 2 +1 | 7" n ] = 2 X 2 + a 2 a.s. 
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Consequently, if we choose c n = 1 + X 2 for all n > 1 , we clearly have for all k G 
E l v 2k\ Fn] < max(a 2 , a 2 c )c k and E [V 2 \ +l \ F n ] < max((x 2 , aj)c k a.s. 



It is exactly the reason why we have chosen this weighting sequence into (3.4). 
Similar WLS estimation approach for branching processes with immigration may be 
found in [22] and [23]. For all n > and for all k G G n , denote v 2k = ^fc-^t^fel-^n]- 
We deduce from (3.6) that for all n > 1 

where 

77 = 2 and = 



It leads us to estimate the vector of variances rj by the WLS estimator 

1 

Hi. 

fceT n _i 



(3-7) Vn = Qn\ ^ j-V&k 

. - a k 



where 



and for all k G 



d k 

keT„ k 



V2k — X 2k — &nX k — C n , 

y~2k+i = X 2k +\ — b n X k — d n . 

Finally the weighting sequence (d n ) n >i is given, for all n > 1, by d n = c 2 = (1+X 2 ) 2 . 
This choice is due to the fact that for all n > 1 and for all k G G n 

E[vj k \ T n \ = E[V 2 \\T n ] - {E[V 2 \\ J- n ]) 2 a.s. 

= OiJ - al)Xi + Aa 2 a alX 2 k + (^ - a c 4 ) a.s. 

Consequently, as d n > 1, we clearly have for all n > 1 and for all k G G n 

^[vl k \Fn] < max(^ - tr* 2a 2 a c 2 , /4 - a*)d k a.s. 

We have a similar WLS estimator ( n of the vector of variances = (of °d) by 
replacing by V^jL-i into (3.7). Let us remark that, for all n > and for all 

k G G n , 

(3.8) E[V 2k V 2k+l \ JF n \ = Pah X 2 n + Pcd . 

Then, for all n > and for all k G G n , denote w 2k = V 2k V 2k+ i — E[V 2k V 2k+ i\J-' n }. We 
deduce from (3.8) that for all n > 1 

V 2k V 2k+1 = z/^fc + W2& 

where v l = (p a b p c <i). It leads us to estimate the vector of covariances v by the 
WLS estimator 

(3.9) D n = Q~ht y~] -^-V 2 kV 2k+ ii) k . 

*—~ ' d k 

fceT„_i 



ASYMPTOTIC ANALYSIS FOR RCBAR PROCESSES 

This choice is due to the fact that for all n > 1 and for all k e G n 

WZkVl+AFn] = y\ h K + {°lo\ + A PabPcd + a 2 b al)X 2 k + v 2 cd 
Consequently, as d n > 1, we clearly have for all n > 1 and for all k e 



a.s. 



E[<|JT„] 



ci6 



- Pafe)^fc + {°Wd + O-ftCTc + 2pabPcd) X\ + (z/^ - p^) a.S. 



< max {yl h , z/ c 2 d , (cx 2 + cx 2 ) (cx 2 + ct 2 ) ) 4 a.s. 



4. A MARTINGALE APPROACH 

In order to establish all the asymptotic properties of our estimators, we shall make 
use of a martingale approach. For all n > 1, denote 



XkV2k+l 



We can clearly rewrite (3.5) as 
(4.1) 



\ - 9 = ^~\M n . 



As in [3], we make use of the notation M n since it appears that (M n ) n >i a martingale. 
This fact is a crucial point of our study and it justifies the vector notation since most 
of asymptotic results for martingales were established for vector- valued martingales. 
Let us rewrite M n in order to emphasize its martingale quality. Let \l/ n = I 2 <8> <p ra 
where <p n is the matrix of dimension 2x2" given by 



X, 



X 



2™ + l 



I Con 
1 



\/C2"+l 
1 



X 2 n+l_i \ 

y/C 2 n + l _1 
1 

v /C 2 n+l_l/ 



It represents the individuals of the ra-th generation which is also the collection of all 
^k/y/ck where belongs to G n . Let £ n be the random vector of dimension 2 n 



S n 



Voj 



V, 



2" +2 



Von 



2"+l-2 



Vo, 



v 2 . 



Von 



a/ C 2™-1 >/ C2"-l y/C 2 n- 



The vector £ n gathers the noise variables of G n . The special ordering separating odd 
and even indices has been made in [3j so that M n can be written as 



Under (3.1), we clearly have for all n > 0, E[^ n+ i|J-" n ] = a.s. and \I/ n is JF n - 
measurable. In addition it is not hard to see that under (Hjl]) to (H|2]), (M n ) is 
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a locally square integrable vector martingale with increasing process given, for all 
n > 1, by 



n— 1 n— 1 



fc=0 fc=0 



(4.2) <M> n = X)** E fo+ifUil-F*]** = a.s. 

where 



(4.3) i*=E^(r w) Q(A ' ,) ^^ 2 x< 



with 



P(X) = ^X 2 + a 6 2 , 
Q(X) = p ab X 2 + Pcd , 
R(X) = a^ + al 

One can remark that we obviously have < M > n = 0(n) but it is necessary to 
establish the convergence of < M > n , properly normalized, in order to prove the 
asymptotic results for our RCBAR estimators 9 n , rj n , ( n and v n . 

5. Main results 

We have to introduce some more notations in order to state our main results. 
From the original process (X n ) n >i, we shall define a new process (Y n ) n >i recursively 
defined by Y\ = X±, and if Y n = Xk with n, k > 1, then 

Y n +i — X2k+n n 

where {n n ) n >i is a sequence of i.i.d. random variables with Bernoulli B (1/2) distri- 
bution. Such a construction may be found in [9j for the asymptotic analysis of BAR 
processes. The process (Y n ) gathers the values of the original process (X n ) along 
the random branch of the binary tree (T n ) given by (n n ). Denote by k n the unique 
k > 1 such that Y n = Xk- Then, for all n > 1, we have 

(5.1) = a n+iY n + e n+ i 
where, with k n the unique number k such that Y n = X^, 

In o\ ~ J a k n ^ K n = 0, , 

(5.2) a n+l = < . and e n = e kn . 

I Ofc n otherwise, 

Lemma 5.1. Assume that (Hjl]) and (H|2]) are satisfied. Then, we have 

r 

Y — > T 

where T is a positive non degenerate random variable with E[T 2 ] < oo. 
Denote C l b {R + ) = {/ G C 1 (M,M)|3 7 > 0,Vx > 0, (|/'(z)| + |/(ar)|) < 7 }. 
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Lemma 5.2. Assume that (H|T]) and (Hj2]) are satisfied. Then, for all / G Cj( 

we have 

Proposition 5.3. Assume that (Hjl]) to (H|3]) are satisfied. Then, we have 
(5.3) - <M> ' 



lim 



T 



a.s. 



n-l 



where L is the positive definite matrix given by 
L = E 



_J ^(T) Q(T)\ /T 2 T 

1 + T 2 ) 2 ^Q(T) -R(T) y y T 1 



Our first result deals with the almost sure convergence of our WLS estimator 9 n . 

Theorem 5.4. Assume that (Hjl]) to (h|4]) satisfied. Then, 9 n converges almost 
surely to 6 with the rate of convergence 



IT 



n— 1 



a.s. 



\\e n -e\\ 2 = o 

In addition, we also have the quadratic strong law 

(5.4) lim -V|T fc _ 1 |(^-^) t A(^-^) = tr(A- 1 / 2 LA- 1 / 2 ) 

n-»oo n z — ' 



a.s. 



k=l 



where 
(5.5) 



A 



C 



and C = E 



T 2 T 



1 + T 2 \T 1 



Our second result concerns the almost sure asymptotic properties of our WLS vari- 
ance and covariance estimators rf n , ( n and u n . Let 

Vn = Qn-l T V ^ k > 
(n = Qn-1 Yl -T V 2k+l^k, 

v n = Q-\ X~] ^-V 2 kV 2 k + i^k- 

Theorem 5.5. Assume that (HQ to (HQ are satisfied. Then, rj n and ( n converge 
almost surely to rj and ( respectively. More precisely, 

n 



(5.6) 
(5.7) 



\\Vn - Vn\\ = O 
||Cn-Cn|| = 



|T ft _i| 
n 



IT 



n-l 



a.s. 



a.s. 
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In addition, v n converges almost surely to v with 

n 



(5.8) 



T„_i 



a.s. 



Remark 5.6. We also have the almost sure rates of convergence 



\rjn-i]\\ 2 = 



n 



|T„_i| 



\\tn-a 2 = o 



n 



, w n - v \Y = o 



n 



T„-i 



a.s. 



Our last result is devoted to the asymptotic normality of our WLS estimators 9 n , 
rf n , Cn and v n . 

Theorem 5.7. Assume that (Hjl]) to (H|5]) are satisfied. Then, we have the 
asymptotic normality 

C 



(5.9) V\^n-i\(9 n -9)-±> Af{0, A' 1 LA' 1 ). 

In addition, we also have 



(5.10) 

(5.11) 

where 



VlTn-il (Cn - C) ^> AT(0, D^MuD' 1 ), 



D = E 



2 



M ac = E 



M M = E 



(1 + T 2 ) 2 V T 1 
(A - ^)T 4 + 4a 2 a 2 T 2 + (p 4 - a 4 ) (T A T 2 



;i + t 2 ) 4 



T 2 1 



04 ~ + ^ 6 VjT 2 + (/i 4 - a 4 ) / T 4 T 2 



Finally, 
(5.12) 
where 
H = E 



;i + t 2 ) 4 



T 2 1 



T„_i| (P„ - i/) A/" (0, D^HD- 1 ) 



< b - P^ 4 + + + 2p ab p c ,)T 2 + [yl d - p\ d ) ( T 4 T 2 

T 2 1 



(1 + T 2 ) 4 

The rest of the paper is dedicated to the proof of our main results 

6. Proof of Lemma I5TT1 



We can reformulate (5.1) and (5.2) as 



ii— i 



Yn 

a n a n —\ . . . 

0"n a n-l ■ ■ ■ Ofc+lCfc + Cn- 



k=2 



We already made the assumption that both (a n ,b n ) n >i and (£ 2n , £ 2n+i)n>i are i.i.d. 
and that those two sequences are independent. Consequently, the couples (flki e k) 
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and (a n _fc +2 , e„_fc + i) share the same distribution. Hence, for all n > 2, Y n has the 
same distribution than the random variable 

n-l 

Z n — a 2 . . . a n Y\ + a 2 a 3 . . . a n - k+ \e n - k+ 2 + e 2 , 

k=2 
n 

= a 2 ■ ■ ■ a n Yi + y^a 2 a3 • • • a k -ie k + e 2 . 

fc=3 

For the sake of simplicity, we will denote 



k=2 



(6.1) Z n = a 2 ... a n Y 1 + ^ a 2 a 3 . . . a k ^ x e k . 

On the first hand, 

and since 



E[a 2 a 3 ...a n Y 1 ]=E[a 2 ] n - 1 E[Y 1 ] 
a + b 



|E[a 2 ] 



< 1 



this immediately leads to 

lim a 2 a 3 . . . a n Yi = a.s. 
On the other hand, let T n be defined as 



and T given by 



We have 



T n — a 2 a 3 . . . a k -\e k 

k=2 



T = ^ a2 °3 • • • a k-lGk- 
k=2 



E[\T-T n \] = E 



^ a 2 a 3 . . . a fc _!e fc 

k=n+l 



00 

< E E 

k=n+l 



\a 2 a 3 . . .a k -ie k \\ , 



< 



E[|e 2 |] E » 



fe-2 



fc=n+l 



In addition, E[aj[] < 1 and E[&£] < 1 which leads to E[a 2 n ] < 1 and E[|a„|] < 1. 
Consequently, 

m-i E[|e 2 |] 



E[|T-T n |]<E[|a 2 |]' 



1-E[|a 2 | 



12 VASSILI BLANDIN 

1} 

This proves that T n — > T which immediately implies that 

£ C 

T n — y T and Y n — > T. 

Moreover, we can easily see that (Hjl]) allows us to say that E[T 2 ] < oo thanks to 
Cauchy-Schwarz inequality. It only remains to prove that T is not degenerate. Let 
us write T n as 

n 

T n = e 2 + E" 2 . . .ak-ie k . 

k=3 

Since e 2 is independent of (a 2 . . . a k _iek)k>3, we have 

(6.2) Var(T n ) = Var(e 2 ) + Var ^E^ 2 • • -ak-ie^j > Var(e 2 ). 

Moreover, it is easy to see that 
(6.3) 

Var(e 2 ) = ^ + °' + + - - f C + d V = U i + °1 + (c ~^ > °A + °1 > Q 



Consequently, as (T n ) converges in distribution to T, we obtain from Levy's conti- 
nuity theorem, (6.2) and (6.3) that 

Var(T) = lim Var(T n ) > Var(e 2 ) > 0. 

7. Proof of Lemma 15.21 
We shall now prove that for all / G C^(R+), 

lim n^E/™ = E [/( T )]- 



fe£T„ 



Denote <? = /-E[/(T)], 

M T „(/) = ^ E /(**) and = j^T E /(**)■ 

Via Lemma A. 2 of [3J, it is only necessary to prove that 

lim wkl E 9( x k) = a.s. 

n^oo \U n \ f—f 

We shall follow the induced Markov chain approach, originally proposed by Guyon 
in [9j. Let Q be the transition probability of (Y n ), Q p the p-th iterated of Q. In 
addition, denote by v the distribution of Y\ = X\ and vQ v the law of Y p . Finally, 
let P be the transition probability of (X n ) as defined in [9J. We obtain from relation 
(7) of [9J that for all n > 

1 n-1 

E[M Gn ( g ) 2 ] = —vQ n g 2 + E ^Q k P{Q M 9^Q n - k - x 9) 

k=0 
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oo oo oo n—1 
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71=0 



n=0 



n=l fc=0 



(7.1) 



fc=0 V V Z=0 / / 



However, for all x G N, 

Q n 9(x) = Q n f(x) - E[/(T)] = E«[/(y B ) - /(T)] = E x [f(Z n ) - f(T)} 



where Z n is given by (6.1). Hence, we deduce from the mean value theorem and 
Cauchy-Schwarz inequality that 

(7.2) \Q n g(x)\ < E x [W n \Z n - T\] < E S [^] 1 /\[(Z B -T) J ] 1 / J 

where 

W n = sup \f(z)\. 

z&[Z n ,T] 

By the very definition of Cj(R+), one can find some constant 7 > such that 
\f(z)\ < 7 - Hence, 



(7.3) 

Furthermore 



Z n — T — a 2 ■ ■ ■ a n Yx — £^ a 2 . . . a k Ck+\ 

k=n 

and the triangle inequality allows us to say that 



\2U/2 



E x [(Z n - T) 2 ] 1/2 < ^[(03 . . . a„y0 2 ] 1/2 + E E *p2 • • ■ afcefc+ij 

fc=n 
00 

< E[^ n -^ 2 E X [Y^ 2 +^E :r [a^ fe - 1 )/ 2 E[ e 2 +1 ] 1 / 2 



< \/E[a 2 ] 



-n-l 



X + 



Eje 2 ] 1 / 2 
1 -E[a 2 ]V2 



(7.4) 
where 



< a^/Efa 2 ,] (l + \x\) 

( E[e 2 ]V 2 
V '1-E[S 2 P 



a = max 



]l/2 J ' 



Finally, we obtain from (7.2) together with (7.3) and (7.4) that 



-n-l 



|Q n ^)l <7«A/E[a 2 ] + 



14 

Therefore, 
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(7.5) 



HEi<r»*<™i< r % f i'(***> 



where, for all i6N, h(x) = 1 + \x\. We are now in position to prove that 



(7.6) 



E 



n=0 



< oo. 



Let G be be the random vector defined by G(x) = (a±x + 62, b\X + £3)*. We can 
easily see from (H|2]) that it exists some constant (3 > such that 

P(h * h){x) = E[(h * h)(G(x))} < (3{1 + x 2 ). 



Consequently, since, for all \g(z)\ < 27, we obtain from (7.1) together with 

( [7~5] that 

OO OO / O 2 2 



n=0 



fc=0 



< 87 



(7.7) 

In addition, we also have 



< E x [(a 2 . . .a^) 2 } 1 ' 2 + ^E x [(i 2 . . . a k ^e k ) 



211/2 



fc=2 

00 



< 



E[zi]^y 2 E x [Y 2 ] i/2 + j2^l] (k - 2)/2 nei +1 ] 1/2 , 



k=2 



(7.8) 



< E[X 2 ] 1/2 



E[e 2 } 1 / 2 
1-E[a 2 ] 1 / 2 ' 



Then, (7.7) and (7.8) immediately lead to (7.6). Finally, the monotone convergence 
theorem implies that 

limM Gn (#) = a.s. 
which completes the proof of Lemma |5.2[ 

8. Proof of Proposition [573] 



The almost sure convergence (5.3) immediately follows from (4.2) and (4.3) to- 
gether with Lemma 5.2 It only remains to prove that det(L) > where the limiting 
matrix L can be rewritten as 

where 



(P(T) Q(T)\ 
\Q{T) R(T)J 



L = E [T <g> C] 
and C = 



T 2 T 



[1 + T 2 ) 2 \T 1J- 
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We have 



(8.1) 



E 





+ E 




®c 






\pcd ai) 





Pab 



P t ) ® E[T 2 C] 



&c Pcd 
Pcd o\ 



®E[C]. 



We shall prove that E[C] is a positive definite matrix and that E[T 2 C] is a positive 
matrix. Denote by Ai and A2 the two eigenvalues of the real symmetric matrix E[C]. 
We clearly have 

A x + A 2 = tr(E[C]) =E ,5 >0 



;i + T 2 )^ 



and 



AiA 2 = det(E[C]) = E 



T 2 



(1 + T 2 ) 2 



E 



_(1 + T 2 ) 2 _ 



E 



T 



_(1 + T 2 ) 2 _ 



> 



thanks to the Cauchy-Schwarz inequality and A1A2 = if and only if T is degenerate, 
which is not the case thanks to Lemma 5.1 Consequently, E[C] is a positive definite 
matrix. In the same way, we can prove that E[TC] is a positive matrix. Since 
the Kronecker product of two positive (respectively definite positive) matrices is 
a positive (respectively definite positive) matrix, we deduce from ( |8.1 ) that L is 
positive definite as soon as p 2 d < o 2 c a 2 d and p 2 b < c 2 a a\ which is the case thanks to 
(Hj3l). ' 



9. Proof of Theorem 15.41 

We will follow the same approach as in Bercu et al. [3J. For all n > 1, let 

V n = M l jr n \M n = (0„ - #)*£„_!(#„ - 6). First of all, we have 

V n+1 = Ml +1 E^M n+1 = (M n + AM n+i yZ- l (M n + AM n+1 ), 
= M*S^M n + 2MX x AM n+1 + A^E^, 
= V n - M*(E;^ - E; 1 )]^ + 2M t n Z; i 1 AM n+1 + AM* +1 S^AM n+1 . 

By summing over this identity, we obtain the main decomposition 

(9.1) V n+ i + An = Vi + #n+i + W n+ i 

where 

fc=i 

n n 

£ n+1 = 2 ^ .U/v.A.l/,., and W n+1 = ^ A.\//. . , >;, 1 A.\/, . ; . 



fc=i 



k=l 



Lemma 9.1. Assume that (H|T]) to (H|3]) are satisfied. Then, we have 



(9.2) 



hm 

n— s>oo 



\tr((I 2 ®C)- l/2 L(I 2 ®C)- l/2 ) 



a.s. 
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where C is the positive matrix given by (5.5). In addition, we also have 

(9.3) B n+ \ = o(n) a.s. 
and 

(9.4) i im K+1 + An = l tr{{I 2 ® Cy^Lih ® Cy 1 ' 2 ) 

n->oo n 2 

Proof. First of all, we have W n+ i = T n+ i + 7Z n +i where 

" AM^ +1 (J 2 0C)- 1 AM H1 
1+1 ^ iTfcl 



a.s. 



k=l 



— 



AM* +1 (|T fc 


y- 1 - 


- {h ® C)- 1 )AM fc+1 









fc=l 

One can observe that 7~„+i = tr((I 2 ® Cy 1/2 U n+ i(I 2 ® Cy 1/2 ) where 



" AM fc+1 AM* +1 



fc=l 

Our aim is to make use of the strong law of large numbers for martingale trans- 
forms, so we start by adding and subtracting a term involving the conditional ex- 
pectation of AH n +i given T n . We have thanks to relation (4.3) that for all n > 0, 
E[AA/ n+1 AM^ +l \ J^n] = L n . Consequently, we can split ti n +i into two terms 

n L k 

k=l ' fc ' 

where 



_ A AM k+l AM{ +l - L k 



fe=l 



It clearly follows from convergence ( |5.3[ ) that 



Um £ = h a.s. 

Hence, Cesaro convergence immediately implies that 

^ n T 1 

(9.5) lim Hw~\= o L a - s - 

fe=l 

On the other hand, the sequence (/C n )„>2 is obviously a square integrable martingale. 
Moreover, we have 

A/C n+ i = fC n+ i - K n = — — (AM„ +1 AM^ +1 - L n ). 

I n\ 

For all ueR 4 , denote K n (u) = u l lC n u. It follows from tedious but straightforward 
calculations, together with Lemma |5~2| that the increasing process of the martingale 
(/C n (w)) n >2 satisfies < K.(u) >„= 0(n) a.s. Therefore, we deduce from the strong 
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law of large numbers for martingales that for all u € IR 4 , K n (u) = o(n) a.s. leading 
to K n = o(n) a.s. Hence, we infer from (9.5) that 

(9.6) 



lim = —L a.s. 

n->oo n 2 



Via the same arguments as in the proof of convergence (5.3), we find that 



(9.7) 



lim 



IT 



C a.s. 



where C is the positive definite matrix given by (5.5). Then, we obtain from (9.6) 
that 

lim Ik = -tr((I 2 <g> C)- 1/2 L(I 2 <g> C)- 1/2 ) a.s. 

rwoo n 2 



which allows us to say that lZ n = o(n) a.s. leading to (9.2) We are now in position 
to prove (9.3). Let us recall that 

n n 

B n+l = 2 ^. !/;.>;,• A. \/,., = 2^M*Er 1 ^fe+i- 
fc=i fc=i 

Hence, (B n ) n >2 is a square integrable martingale. In addition, we have 

AB n+1 = 2M*E„ 1 AM n+1 . 

Thus 

E[(AB n+1 ) 2 \ 7 n \ = 4E[M*S; 1 AM n+1 AM* +1 S; 1 M n | 7 n \ a.s. 

= 4M^ 1 E[AM n+1 AM* +1 | J^E^M,, a.s. 
= 4M*S; 1 L n S~ 1 M n a.s. 



We can observe that 
and 



S3 



1 fP{X k ) Q(X k 



feeG„ 



g(X fc ) R{X k 



X k 1 



For a = max(a 2 , a 2 ) + max (of, cr^) + max(|p a &|, \p c d\), denote 

( a P(X n ) QjXn) \ 



Q{x n ) 



a 



(-it 

RjXn) 
C n ) 



We can rewrite ct\I/ ri \I/^ — L n as 
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It is not hard to see that A n is a positive definite matrix. As a matter of fact, we 
deduce from the elementary inequalities 



(9.1 



that 



fo<P(X)<max(a 2 ,a c 2 )(l + X 2 ), 
lo<R(X)<maxtf,(T*)(l + X 2 ), 
[\Q(X)\ <max(|p afe |,|p cd |)(l + X 2 ), 



tr(A r 



2a 



P{X n ) R{X n 



> 2a — max(cr a , a 2 ] 



max(cx 2 , a 2 d ) > 0. 



In addition, we also have from (9.8) that 

c 2 det(A n ) = (ac n - P(X n ))(ac n - R(X n )) - Q 2 (X n ), 

= ac n (ac n - P(X n ) - R(X n )) + P(X n )R(X n ) - Q 2 (X n ), 

> P(X k )R{X k ) + ac\ max(|p a6 |, |p cd |) - Q 2 {X n ), 

> P{X k )R{X k ) + max(|p a6 |, \p cd \fc 2 n - Q 2 {X n ) > 0. 

Consequently, A n is definite positive which immediately implies that L n < a^ n ^\ 
Moreover, we can use Lemma B.l of |3] to say that 



Hence 



E[(AH 



n+lj 



\F n ] = 4M*E; 1 L n E" 1 M n a.s. 



a.s. 



< 4aM*(E;\ - E^)M n a.s. 



leading to < B> n < AaA n . Therefore it follows from the strong law of large numbers 
for martingales that B ri 



Vn 



o(An). Hence, we deduce from decomposition (9.1) that 
A n = o(An) + 0(n) 



+i 



a.s. 



leading to V n +\ = 0(n) and A n = (D(n) a.s. which implies that B n = o(n) a.s. Fi- 
nally we clearly obtain convergence (9.4) from the main decomposition ( [9.1 ) together 



with (9.2) and 9.3, which completes the proof of Lemma 9.1 



□ 



a.s. 



Lemma 9.2. Assume that (HjT]) to (Hj4]) are satisfied. For all 5 > 1/2, we have 

\\M n \\ 2 = o(\T n \n s ) 

Proof. Let us recall that 

/ X k V 2l , \ 



V 2k 

XkV2k+l 

\ V 2k+ i ) 
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Denote 



P n = ^2 XkV2k and Q n = ^ 



Ck 



On the one hand, P n can be rewritten as 



V2k 
Ck ' 



Pn = ^2 V\ G k-i\fk where f n = ■= ^ 

V l^n 



XkV2k 



k=l 



fcGG n _ 



Ck 



We already saw in Section 3 that for all k G G n , 

W 2k \F n ] = and E[V 2 2 k \ F n ] = a 2 a X 2 + a 2 = P(X k ) a.s. 
In addition, for all k G G n , 

E[V 2 \\T n ] = ^ a Xt + Qa 2 a a 2 X 2 k + ,4 a.s. 

which implies that 

(9.9) nV 2 \\F n ] < fitcl a.s.. 

where [i\ c = max(/^, 3 cr^a 2 , /i 4 ). Consequently, E[/ n+ i| J^] = a.s. and we deduce 
from (9.9) together with the Cauchy-Schwarz inequality that 



|G n 



-E 



E 



x k v. 



kV2k 



Ck 



|G„ 



— y 

l 2 



fcgG n 



X^ 4 E[K, 4 fc |j;] 



+ 



EE 

fcGG n iGG n 



x k y fx l \ 2 WZk\Fn] 



c k 



Cl 



- E + -J-fi E E m ax(a> c 2 ) 2 



fcGGn 



fceG„ «eG 



(9.10) </4 + 3max(<7>^ a.s 



Therefore, we infer from (9.10) that 

supE[/^ +1 |.F n ] < oo a.s. 



n>0 



Hence, we obtain from Wei's Lemma given in [2 lj page 1672 that for all 5 > 1/2, 

P 2 = o(\T n ^\n 5 ) a.s. 
On the other hand, Q n can be rewritten as 
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Via the same calculation as before, E^+ilJ-^] = a.s. and, as c n > 1, 

E[^+i|^n] < /4i + 3 max(a 2 , a 2 .) 2 a.s. 
Hence, we deduce once again from Wei's Lemma that for all 5 > 1/2, 

Ql = o(\T n _ 1 \n 5 ) a.s. 

In the same way, we obtain the same result for the two last components of M n , 
which completes the proof of Lemma 9^2 □ 

Proof of Theorem 



5.4 



We recall from (4.1) that 9 n — 6 = H n _ 1 M n which implies 

Vn 



\o n -er<- , 

^min yt-'n— 1 , 



where V n = M l jr n \M n . On the one hand, it follows from ( |9.4[ ) that V n = 0(n) a.s. 
On the other hand, we deduce from < \9.7 ) that 



lim 



Consequently, we find that 



(C) > a.s. 



\9n-9\\ 2 = 



n 



Tn-l 



a.s. 



We are now in positio n to prove the quadratic strong law (5.4). First of all a direct 
application of Lemma 9.2 ensures that V n = o(n 5 ) a.s. for all 5 > 1/2. Hence, we 
obtain from (9.4) that 



lim ^ = l -tr{{h ® C)- 1 / 2 L(J 2 ® C)- 1 / 2 ) 

ra-»oo n 2 



a.s. 



(9.11) 
Let us rewrite A n as 

n n 



k=l 



where = I4 — S^ 2 1 S fc 1 S^ 2 1 . We already saw from (9.7) that 



k=l 



lim 



IT 

11 r. 



I 2 ®C a.s. 



which ensures that 



lim A r 



y n — —14 a.s. 

n— >oo Z 



In addition, we deduce from ( |9.4[ ) that A n = 0{n) a.s. which implies that 
(9.12) 



A 

n 



fc=i / 
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Moreover we have 



n 1 n 

- E Mt ^\ M * = - - *)* E *-i 



fc=i 



fc=i 



(9.13) 



1 y 
-El^-iK^-^nr^T^- )' 

1 n 

- E |T fe _i|(0fc - 0)*(/ 2 8) CO(0 fc - 0) + o(l) 



a.s. 



fc=i 



Therefore, (9.11) together with (9.12) and (9.13) lead to (5.4) 



10. Proof of Theorem 15.51 



First of all, we shall only prove (5.6) since the proof of (5.7) follows exactly the 



same lines. We clearly have from (3.7) that 

Qn-l(Vn ~ Tjn) = E T^ k ~ V ^ k > 



n-l 



1 ^ 

n— 1 - 

E E ( ( ^ 2fc ~ ^ + 2 ^ 2k ~ v ^ V2k ) ^- 



(10.1) 

1=0 fceG; 

In addition, we already saw in Section 3 that for all / > and fc 6 Gj, 

ai — a 



v 2k -v 2k = -(^_ c ) $ k . 



Consequently, 



(V 2k ~ V 2k f < ||$ fc f ((a, - a) 2 + (q - c) 2 ) = c k ((a, - a) 2 + (q - c) 2 ) 



Hence, as HV'fcll 2 = + 1 < c 



n— 1 



\ (^2fc — ^2fc) 2 

LL — ^ ^ 



n-l 



Cfc \\ipk\ 



di 



((a, - a) 2 + (q - c) 2 ) 



Z=0 fcSG( 
n-l 

<ElG/|((a,-a) 2 + (Q-c) 2 ). 



However, as A is positive definite, we obtain from (5.4) that 

n-l 



E N ((a, - a) 2 + (q - c) 2 ) = 0(n) a.s. 
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which implies that 
(10.2) 

Furthermore, denote 



n-l 

EE 

1=0 fceG; 



(V 2k U * 



'2fcy 



0(n) a.s. 



n-l 



r, (^2fc — V2kjV2k i 
P n = 2^1^ 3 



z=o fceG; 



4 



We clearly have 



— "n+1 — "n — 2_, j 



fcSGn 



fe£G n 



2fc „/. I a l~ a 

Ci — C 



E >• 



In addition, for all k G G n , EfV^JPn] = a.s. and E[V^| J~ n ] = ^l^k + v\ < aQc 
a.s. where a = max(cr 2 , cr 2 ). Consequently, E[AP n+ i| .F„] = a.s. and 



E[AP n+1 AP* +1 |.P n ] = J2 ^nV 2 l\F n }^ 



fcsGn 



E 



4 / a; - a \ a t - a 
' ' ci — cj \ci - c 

t 



a.s. 



P(Xk) , I ai-a\ j en — a 

, 2 ^fc^fc 



Ci- C I \Ci-C 



a.s. 



Therefore, (P n ) is a square integrable vector martingale with increasing process 
<P> n given by 

n-l 

<P> n = J]E[AP m AP/ +1 |P z ] a.s. 



1=1 

n-l 



EE 

/=i keGi 



P( y X k) 1 (% - a\ fai - a 



a.s. 



It immediately follows from the previous calculation that 

c fc ||^|| 2 ||$ fe || 2 



<P>n || <«$^((^-a) 2 + (Q-c) 2 ) 



1=0 

n-l 



fceG; 



4 



a.s. 



< a^|Gi| ((a, - a) 2 + (q - c) 2 ) a.s. 



1=0 



leading to 

\\<P> n \\=0{n) a.s. 

Then, we deduce from the strong law of large numbers for martingale given e.g. in 
Theorem 1.3.15 of |8| that 



(10.3) 



P n = o{n) 



a.s. 
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Hence, we find from (10.1), (10.2) and (10.3) that 



\\Qn-l{Vn ~ Vn)\\ = 0{n) 



a.s. 



Moreover, we infer once again from Lemma 5.2 that 



(10.4) 



lim - — 

n-»oo X r 



-Q n = D = E 



rp4 rp2 

2 



[1 + T 2 ) 2 \T 2 1 
which ensures, since D is positive definite, that 



a.s. 



\rfn - Vn\\ = O 



n 



|T n _i| 



a.s. 



It remains to establish (5.8). Denote 



where 



J 



1 

1 0) ' 



Then, we have from (3.9) that 



fcST n _i 



It is not hard to see that (R n ) is a square integrable real martingale with increasing 
process given by 



n-l 



(W k - W k f JW k WiJ{W k - W k )M 



JTt n 



<R> n = j2J2 E 

i=o fceG; 

= Yl Yl 12 ( w k - WtfJE [W k Wl\F n ] J(W k - W k )^{ a.s 



a.s. 



d 2 

1=0 k&Gi k 
n-l 



E E V» - W) %xj) J ^ ~ w ^ 



a.s. 



i=o fceG; k 
n-l 



EV 1 ( t7? w \t ( R(X k ) Q(X k 



(W* - W*)^ a.s. 
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Consequently, Lemma 5.2 together with (5.4) allows us to say that || <R> 



0{n) a.s. which ensures that R n = o(n) a.s. Moreover, 



^ J- [ \ 21: - ^ 21: ) ( \ 21, + 1 - \ 2A- + J ) ' 'A- 



fceT 



< 



5 E ^((^-Vi) 2 +(^«-vi +1 ) 2 ) 

1 n— 1 



£ 2 ' ' ""' 

n-1 



\*kTUk\ 



fceG; 

2 



z=o 



which implies via (5.4) that 



fceT n _i 

Therefore, we obtain that 



^2 (^ 2fc ~~ V2k ) ( V 2k+i ~ V 2k +ij tph 



0(n) a.s. 



|T n _i | H^Vj — b> n \\ = 0(n) a.s. 



which leads to (5.8). Finally, it only remains to prove the a.s. convergence of r/ n , ( n 



and v n to 77, £ and v which will immediately lead to the a.s. convergence of f} n , ( n 



and v n through (5.6), (|5.7|) and (|5.8|), respectively. On the one hand, 
(10.5) 



Qn~l{Vn ~ V) = N n = V" 

rrr CLk 



where we recall that v 2n = V 2n ~ rfipn- It i s clear that (N n ) is a square integrable 
vector martingale with increasing process <N> n given by 



n— 1 ^ 

< N >n = Yl ^[ v lk\H^l a.s. 



1=0 fcec 

n— 1 j 

where 7 = max(/4 — er^, /4 — cr^). Hence, 

n— 1 



z=o fcec. 



n<iv>„ ii<7E£j, 

which immediately leads to 



^•|| 2 < 7l T n| a.s. 



<iV> n || =0(|T n _ 1 |) a.s. 
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Consequently, 



\N„ 



0(n\T n ^\) a.s. 



which leads via (10.4) and (10.5) to the a.s. convergence of rj n to r\ and to the rate 
of convergence of Remark 5.6 The proof of the a.s. convergence of ( n to ( follows 
exactly the same lines. On the other hand 

(10.6) Q n -\{y n - v) = H n = ^2 ~1- W 2k1pk 



fceT„ 



where we recall that w 2 k = V 2 kV 2 k+i — E[V2fcV r 2fc+i|.7 r n ]. It is obvious to see that (H n ) 
is a square integrable real martingale with increasing process 



n— 1 ^ 



1=0 fceG; k 
n—1 j 

;=0 keGi k 

where a = max (v% b , v^, (cr^ + of) [a\ + of)). This implies that 

n— 1 

dk 

which allows us to say that 

\\H n \\ 2 = 0(n|T n _!|) and 



<H> n || < aJ2 Yl jrll^H 2 ^ «I T «-^I 



o 



n 



Tn-l 



a.s. 



Finally, we deduce from ( 10.6) that v n goes a.s. to v and that the rate of convergence 



of Remark 5.6 is verified, which completes the proof of Theorem 5.5 



11. Proof of Theorem [57F] 

In order to establish the asymptotic normality of our estimators, we will exten- 
sively make use of the central limit theorem for triangular arrays of vector martin- 
gales given e.g. by Theorem 2.1.9 of [8J. First of all, instead of using the generation- 
wise filtration (J- n ), we will use the sister pair- wise filtration (Q n ) given by 

Q n = a(Xx, (X 2 k,X 2k+l ), l<k<n). 



Proof of Theorem 5.7, first part. We focus our attention to the proof of the 



asymptotic normality (5.9). Let M^ n > 
martingale defined as 



(M^ n) ) be the square integrable vector 



11.1) 



M, 



(n) 
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Di 



( x,y 2l \ 
v 2i 

XiV 2 i+i 

V V 2i+1 J 



We clearly have 
(11.2) 



.1/. 



(n) 



n i i=i 



n+l 



where t n = |T n |. Moreover, the increasing process associated to (M^) is given by 



k 

<M(n)>fc = ^E E NiM 



i=l 



a.s. 



Consequently, it follows from convergence (5.3) that 



lim <M {n) > t = L a.s. 



It is now necessary to verify Lindeberg's condition by use of Lyapunov's condition. 
Denote 



^ = 5>[||^-M& 

fc=l 

We obtain from ( |11.1[ ) that 



fc=i 



(1 + Xp 2 2 2 2 

4 V^2fc + > / 2fc+lJ 



2 tn 1 

^ nr"^ E j ( E ^l^-i] + E^Uil^-i]) . 



fc=i 



In addition, we already saw in Section [9] that 

WllOn-l] < VL<?„ WL + l\Qn-l] < l4 d C 2 n a.S. 

where /4 = max(^, 3aja 2 , (£) and /4 d = max(/4, 3a fe 2 ^, /^). Hence, 



2Q4 + /4) 

\ ; ; ti.b. 

TJ 



which immediately implies that 



lim (j) n = a.s. 
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Therefore, Lyapunov's condition is satisfied and Theorem 2.1.9 of [8J allows us to 

1 



say via (11.2) that 



r- - M n 

V\^n-l\ 



Af(0,L). 



Finally, we infer from (4.1) together with (9.7) and Slutsky's lemma that 

C 



□ 



Proof of Theorem 5.7, second part. We shall now establish the asymptotic 
normality given by ( |5l0| ). Denote by iV» = (A^ n) ) the square integrable vector 
martingale defined as 



(n) 



1 fc 



We immediately see from (|10.5|) that 
(11.3) 



(n) 



Qn(Vn+l ~ Tf) 



n+l- 



In addition, the increasing process associated to (iV^ ) is given by 



< 



V J2A i it 



/i-l 



1 ^ (Mi - °2 W + 4o-^aiX/ + - a 



IT 

11 r. 



E 

i-1 



Consequently, we obtain from Lemma [5. 2| that 

(/4 - ^ 4 + 4a 2 a 2 T 2 + (^ - a 4 ) / T 4 T 2 

T 2 1 



lim <N {n) 



E 



(1 + T 2 ) 4 

In order to verify Lyapunov's condition, let 

in 



M ac a.s. 



fc=i 



E E N n) -^iii 3 



We clearly have 



which implies that 



W 112 



1 *4| 

IT I r/ 2 1 



r(») )\r(») II 3 - 1 l^fcl 



i^r-^riii< 



II 2 <r 1 ^fc 

— Irrp I 7 J 

\n-n\ a k 
1 |V2fc| 



|T n |3/2 d 3/2 | Tn |3/2 c 3 



However, 



«2fc 



11.4) 



4 /_2 \r1 I ^2\ i qt/2 / _2 ta2 i _2\2 , /_2 \^2 , _2\3 



IT/2 Jy2 2|3 ^ /t/2 , ^2^2 i ^ 

1^2* ~ a a X k -°c\ < \ V 2k + °a X k + °. 



2 V 2 „2^3 



< V 2 % + W 2 \(aiXi + a 2 c ) + 3V 2 Ua 2 a Xi + + (a 2 X 2 + ^ 
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We already saw that E[V^.|C?fc_i] = <J 2 a X k + a\ a.s. and that E[V^.|^-i] < PacC 2 . a.s. 
Moreover, it can easily be seen that 

Wl\Qk-i] < r 6 ac 4 a.s. 

where r^ c = max (t% + lOyVfr,?, 5/i^cr 2 , + IOa/t^t^ . Consequently, we 
deduce from (11.4) that it exists some constant 7 > such that 



E[M 3 |£fc-i] < l4 a.s. 



Then, we can conclude that 



which immediately leads to 



< 



7 



n — /t^= — r 



a.s. 



lim 

n— ¥00 



= a.s. 

Therefore, Lyapunov's condition is satisfied and we find from Theorem 2.1.9 of [8] 
and (11.3) that 



(11.5) 



1 



N n -^N(0,M ac ). 



Hence, we obtain from (10.4), ( |11.5[ ) and Slutsky's lemma that 



Finally, (5.6) ensures that 



The proof of (5.11) follows exactly the same lines. □ 
Proof of Theorem 5.7[ > third part. It remains to establish the asymptotic 
normality given by ( [5~l2| . Denote by ffW = the square integrable martingale 

defined as 



H 



(n) 



1 ^ w 2i 



IT 



n > i=l 



We clearly have 



H 



(n) 



IT 



«i i=i 



ra+1- 



Moreover, the increasing process of (H^) is given by 

1 AeK|5 m ]#! 



i=i 



In addition, we already saw in Section 3 that 



y ab 



plb) X k + (^d + Vb a t + ^PabPcd)X 2 k + - p^) a .S. 
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T 2 1 



Then, we deduce once again from Lemma 5.2 that 
lim <H {n) > t 

n—foo 

_ F [ (»& - Pl b )T 4 + (gggj + gggg + 2p afcPct j )T 2 + (z, 2 d - pl d ) {T 4 T 2 

L (l + T 2 ) 4 

= H a.s. 

In order to verify Lyapunov's condition, denote 

0n = E E [H^ n) -^-lH 3 
k=l 

As in the previous proof, we clearly have that 



Qk-i 



II rr(n) _ rr(n) ,,3 ^ 1 l W 2fc| 
H-Hfc -"fe-lll ^ | T 13/2 „3 ' 

We can observe that 

|^2fc| 3 = \V 2k V 2k+1 - PabXl - p cd \ 3 < (\V 2k V 2k+1 \ + \pab\Xl + \pcd\) 3 , 

< \(v£ k + v 2 \ +l ) + 3V 2 lV 2 2 k+1 (\ Pab \Xl + \ Pcd \) 

+ \{v 2 \ + v 2 \ +l ){\ Pab \xl + \ Pcd \f + {\ Pab \xl + | Pcd |) 3 . 

Hence, it follows from the previous calculations that it exists some constant £ > 
such that 



E[K| 3 |&_i] < ic\ a.s. 



which immediately leads to 



n\\H [ k n) - H^Gk-i] < 



IT J 3 / 2 



a.s. 



which ensures that 



< 



T, 



a.s. 



Then, we obviously have that 



and we can conclude that 



lim (j) n = a.s. 

n— >oo 



' H n ^Af(0,H). 



In other words 



C 



T„_i|K - i/) ^ AT^D-'HD- 1 ) 



Finally, we find via (5.8) that 



VW^lPn -v)-^ Af(0, D- l HD- 1 ) 
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which achieves the proof of Theorem |5.7| □ 
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